Approximating Spectral Impact of Structural Perturbations in Large Networks 
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Determining the effect of structural perturbations on the eigenvalue spectra of networks is an 
important problem because the spectra characterize not only their topological structures, but also 
their dynamical behavior, such as synchronization and cascading processes on networks. Here we 
develop a theory for estimating the change of the largest eigenvalue of the adjacency matrix or 
the extreme eigenvalues of the graph Laplacian when small but arbitrary set of links are added or 
removed from the network. We demonstrate the effectiveness of our approximation schemes using 
both real and artificial networks, showing in particular that we can accurately obtain the spectral 
ranking of small subgraphs. We also propose a local iterative scheme which computes the relative 
ranking of a subgraph using only the connectivity information of its neighbors within a few links. 
Our results may not only contribute to our theoretical understanding of dynamical processes on 
networks, but also lead to practical applications in ranking subgraphs of real complex networks. 
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I. INTRODUCTION 

The theory and application of complex networks have 
been a popular and exciting research topic since the sem- 
inal work [l|, Q appeared at the end of last century. The 
study of complex networks interests a variety of fields, 
such as mathematics, physics, computer science, sociol- 
ogy, and biology, to list a few. (For excellent reviews, 
see for example Refs. One of the most important 

problems in complex networks, both from a theoretical 
and applicative viewpoint, is that of measuring central- 
ity. Various measures of centrality have been proposed 
based on different quantitative properties of the under- 
lying network. Examples are degree centrality, shortest 
path and random walk betweenness, clustering coefficient 
and eigenvector component [4, 6]. Common applications 
of such measures is the ranking of vertices of the net- 
work, in particular in the context of web search engines 
0, ■ Many of these centrality measures are connected 
with the spectral radius of the adjacency matrix of the 
graph; furthermore, the spectral radius itself is crucial 
for a class of dynamical processes on networks [9MTl| . 

A fundamental question in the study of networks is 
then how the spectral radius and other invariant network 
statistics change under structural perturbations, such as 
the removal or addition of a few links, or the modification 
of their strength. This question is particularly relevant 
in the context of evolving networks, since the stepwise 
changes in such networks are typically small, and de- 
veloping efficient algorithms to track the corresponding 
changes in network statistics is crucial in understanding 
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the dynamics of network evolution |12j |. The effect of 
structural perturbations on the spectral radius as well as 
other network statistics has significant consequences for 
the security and robustness of networked systems under 
component failures and intentional attacks. 

Let G = (V, E, Q) be a weighted graph, where V is the 
set of vertices, E the set of directed edges and Q the set 
of weights on the edges. For convenience, we label the 
vertices in V with integers 1, . . . , n. Let A £ M. nxn be the 
adjacency matrix of the graph, where its entry a^- is de- 
fined as the weight on the edge going from node i to node 
j. HA is non- negative and irreducible, then the Perron- 
Frobenius theorem [H, [l3| can be used to show that its 
largest eigenvalue A is non-degenerate and positive, and 
there exist positive left and right eigenvectors associated 
with it. In this case, denote the normalized left and right 
eigenvectors by u and v, respectively (u, v £ R n ), so that 



u T A 



Xu T ', Av = Xv, \\u\\ 2 = \\v\\ 



1. 



(1) 



The condition of non-negativity is equivalent to requir- 
ing non-negative weights on edges; on the other hand, the 
condition of irreducibility corresponds to the graph be- 
ing strongly connected. In this paper, the graphs under 
consideration all share these properties. 

In Ref. [ll| the dynamical importance Ijj of an edge 
from i to j was defined as the amount of relative de- 
crease the removal of this edge causes on A, i.e., if af- 
ter removing such an edge A becomes A — AA^, then 
Iij = AXij/X. Hence the dynamical importance of an 
edge quantitatively captures the effect that the removal 
of such an edge has on the largest eigenvalue of the graph 
adjacency matrix. An analogous definition was intro- 
duced for the dynamical importance of vertices, where Ik 
is the importance of node k. Approximations of these dy- 
namical importances, based on perturbation techniques, 
are given in Ref. [11] : in particular, 1^ and Ik can be 
approximated, respectively, by 



Xu T v 



(2) 



2 



and 



h 



UkVk 



(3) 



where m and Vi denote the i-th component of the vectors 
u and v, respectively. 

In this paper, the notion of dynamical importance is 
extended to measure the spectral impact [34| of a struc- 
tural perturbation in which an arbitrary set of links are 
removed or added, or their weights are modified. Wc 
define the spectral impact (SI) as 



A+B 



A 



(4) 



where A denotes the adjacency matrix of the original 
graph, X\ A is the corresponding spectral radius, while B 
is the adjacency matrix of the graph consisting of all the n 
nodes and the links that are removed, added, or modified. 
Here a positive value of Ib corresponds to an increase in 
A, and a negative value to a decrease. Note that in the 
case of removing a subgraph of A, the entries of B will 
be non-positive. In this framework, the edge and vertex 
importance can be treated as special cases. To enable ef- 
ficient estimations of the spectral impact, formulae based 
on the first and improved first order approximations are 
presented and discussed in detail. These formulae lead 
to the observation that the degree centrality, as a local 
measure, can be viewed as a first order approximation to 
the eigenvector centrality. 

The rest of the paper is organized as follows. Section II 
reports first and second order perturbation results to ap- 
proximate the SI using global information on the graph; 
in particular, the special cases of changing the weight 
on an edge and removing a node are addressed. In Sec- 
tion III, applications to synthetic and real-world graphs 
are presented. Section IV deals with estimating the SI 
using local information on the network. While the ma- 
jority of the results concerns the spectral radius of the 
adjacency matrix of the graph, Section V deals with an 
extension of our method to the graph Laplacian. 



II. APPROXIMATING SPECTRAL IMPACT 
USING GLOBAL INFORMATION 

A. Perturbation results 



is obtained from the derivative A'l^, which depends on 
both A and C but can be computed using the vectors u 
and v, and the matrix C. If A is symmetric, u — v and 
Eq. ([SJ is of the Rayleigh quotient form [lj| . 

For more accurate approximation, we can use a second- 
order perturbation result: 



AA m Ai + A 2 = e A'L + — A 



(6) 



Computing the second derivative term using known per- 
turbation results would require knowledge of all the 
eigenvalues and eigenvectors of A [l4|. This is impracti- 
cal. Hence, a further approximation is introduced, as 



n 



A' I 



A+eC 



A'L 



(7) 



The term A' 



A+cC 



takes into account the change in u and 



V, to u + Au and v + Av, respectively. It is proposed here 
to estimate v + Av by means of one iteration of the power 
method [35j ] . starting from the unperturbed eigenvector 
v, as 



Ai 



{A + eC)v 



Xv + eCv 



||(A + eC>|| 2 \\Xv + eCv\\ 2 
Xv + eCv 

VX 2 v T v + 2eXv T Cv + e 2 v T C T Cv 
Xv + eCv 



A 



(8) 



where e terms in the denominator have been neglected. 
Thus 



Av « -Cv. 
X 



Similarly, it can be found that 

c 



Au 



A 



C'u. 



(9) 



(10) 



Therefore, the derivative A'| yl+cC can be approximated 
as 



A' 



A+eC 



(u + Au) C{v + Av) ^ 
(u + Au) T (v + Av) 
u T Cv u T CAv Au T Cv 



Suppose a graph is modified so that its adjacency ma- 
trix A becomes A + eC . Let A be the largest eigenvalue 
of A, and A + AA the largest eigenvalue of A + eC. The 
change AA can be estimated, when e <C 1, using a first- 
order perturbation result [l3| - [l6} , as 



AA w Ai = e A'L - 



i T eCv 



(5) 



where A'l^ denotes the derivative of A + A A as a function 
of e, evaluated at e = 0. Equation (JSJ) shows that — 
at the first order — the change in the largest eigenvalue 



l t Gv 2e u T CCv 



X u T v 



(11) 



having neglected terms containing Au and Aw in the de- 
nominator, and the product Au T CAv in the numerator. 
Thus, an improved approximation for AA is given by 



AA « Ai + A 2 



u T eCv 1 u T e 2 C 2 v 



(12) 



The above formulae take advantage of the fact that in 
many situations the eigenvector does not change much 
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by the perturbation, and thus a few steps (one or two) 
of the power method already give a very accurate ap- 
proximation, as we shall see in the next section. This, 
however, is not the case when the dominant eigenvalue A 
is nearly degenerate, in which case the convergence rate 
of the power method is |^-| ~ 1, where A2 is the sec- 
ond largest eigenvalue in absolute value. More precisely, 
the accuracy of our approximation is related to the spec- 
tral gaps through the perturbation formula, which, for 
undirected networks, takes the form [3(1 



AA = ev T Cv 



i=2 



A - Xi 



where Ai and uw (i > 2) are the non-dominant eigenval- 
ues and corresponding eigenvectors of A. When Ai « A 2 , 
the second term becomes large, indicating that A is highly 
sensitive to perturbations. 



B. Adding or removing an arbitrary subgraph 

Most of the interesting problems in the context of net- 
works involve discrete changes, where A becomes A + B, 
and the nonzero entries of B are finite and usually of the 
same order of magnitude as the nonzero entries of A. If, 
however, the modifications are limited to a small num- 
ber of links in a large network, then ||B|| 2 <C ||^4|| 2 , an d 
the perturbation results ([5]) and (|6]) would be valid with 
eC replaced by B. The other approximations we have 
made are also likely to be valid, and this is supported by 
the fact that Eq. (|T2"j) improves significantly over Eq. ([5]) 
for the example networks discussed in Section [III1 Equa- 
tions ([5]) and ([12")) then become 



AA «Aj = 



AA « Ai 



u T Bv 



u T Bv 1 u T B 2 v 
u T v X u T v 



(13) 
(14) 



and our approximation schemes for the spectral impact 
Ib for small but finite modifications are 



f 1 u T Bv 

I B = T 



X u T v 
1 u T B(v + Bv/X) 
X u T v 



(15) 
(16) 



Equation (| 15[) is linear in B, and therefore the change can 
be decomposed into the sum of elementary changes, as 
B = J2i Bi> where Bi can represent, for example, a mod- 
ification of a single edge. The corresponding first order 
approximation for the SI is obtained from the individ- 
ual contributions, as Is — Ib, • On the other hand, 
Eq. (|16[) has a linear and a quadratic dependence on B 
and linear superposition cannot in general be used. How- 
ever, if all the products of elementary changes BiBj are 
zero matrices (for example, if Si's represent the discon- 
nected components of the subgraph), then Ib = X^i Is,- 



When the changes are limited to a small number of 
links, we have a clear computational advantage of having 
highly sparse matrix B. Also, including changes in the 
eigenvector does not imply much computational burden. 
In fact, the extra computational cost of using Eq. (|14[) in- 
stead of Eq. (|13[) amounts to computing the extra vector 



B and projecting it onto Bv [31 



C. Modifying weight on single edge 

Adding weight bij to directional edge of a graph 
[38j corresponds to changing the adjacency matrix from 
A to A 

zeros except for the entry b t] 



B^ , where B^ is an n x n matrix containing all 



The spectral impact 



I b^ can be approximated, using Eq. (|15p . as 



bijlliVj 

Xu T v 



(17) 



This is equivalent to Eq. @, in the case bi 



' ij ■ 



The second order approximation (|16p introduces a cor- 
rection only if a modification on a self-loop is introduced, 
as (B 2 )ij is zero otherwise. Indeed, 7s y can be approxi- 
mated at the second order as 



(18) 



/b «-^t (1+ ^t )! 

where 6ij is the Kronecker delta. 

If the change is introduced bidirectionally, that is, bij 
is added to the weight of edge (i, j), and bji to edge (j, i), 
then the first and second order approximations to the SI 
become 



and 



If. 



bijUiVj 



l 3 "* u 3 



bjiUjVi 



bjilljVi 



Xu 1 v 



hjbji {uiVi + UjVj) 



(19) 



(20) 



In this case Eq. (|20[) can have nonzero correction term for 
modification of weights on an edge other than a self loop. 
For undirected networks, modification must be bidirec- 
tional and symmetric (bij = bji), and the formulae be- 
come 



and 



2b t 



IbijViVj 



X 



A 2 



(21) 



(22) 



Note that Eq. (|22|) always introduces a non-negative cor- 
rection to the first order approximation for modifications 
to undirected networks. 
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D. Removing a node 

Removing a node k in a graph corresponds to remov- 
ing all edges touching it. In this case, the entries of B 
are 6,-, 



-dij (5, 



ij \"ik ~r "jk 



proximation reads 



Sikfijk) and the first order ap- 



\ A / u 1 v 

while the second order one yields 



(23) 



-1 



A A 2 A 2 



\ UkVk <OA\ 

> a ik a ki (24) 



i=i 



In the case that there is no self-loop connecting node 
k with itself, the above formulae simplify to 



h = -2 



UkVk 



(25) 



TABLE I: Examples of real world networks. 

S2, yeast protein interaction network [19] 
2361 vertices, 13828 edges 
dm 



1, dmean — 5.86, dmax — 65 



A = 19.4861, A 2 



16.1340, A 3 



14.3339 



S3, network of e-mail interchanges [20] 
1133 vertices, 5451 edges 



dmin — 1, d n 



— 9.62, dmax — 71 



A = 41.4940, A 2 = 33.9272, A 3 = 30.0687 
S4, US power grid" 4941 vertices, 6594 edges 

dmin — 1, dmean — 2.67, dmax — 19 

A = 7.4831, A 2 = 6.6092, A 3 = 5.5728 

"The data was retrieved from P. Tsaparas' web- 
page on data sets and codes for complex networks, at 
http: //www. cs .helsinki . fi/u/tsaparas/MACN2006/data- code .html 



and 



1 1 \ u k v k 



A 2 



(26) 



i=l 



The summation term in the last equation represents an 
improvement over the previous result, Eq. ([3]). 

If, furthermore, the network is undirected and un- 
weighted, first and second order approximations become 



and 



JOUt ' 



(27) 



(28) 



where d£ ut 



y —1 a k i is the out-degree of vertex k. 
The last two equations show well that, in the case 
of removing a node, first and second order approxima- 
tions yield rather different results, with the estimate from 
Eq. ((23) more than double that from Eq. (p8"|). This dif- 
ference comes from the fact that, in the case of removing 
node fc, the k-th component of the new dominant eigen- 
vector becomes zero, regardless of its previous value, and 
thus the change in u and v is not negligible. 



III. APPLICATIONS 

In this section, the accuracy of various approximations 
are assessed using both synthetic and real-world graphs. 
The true dominant eigenvalue and corresponding eigen- 
vector are estimated in double precision using the MAT- 
LAB function eigs fl~7T ] and compared to the estimates 
obtained by implementing our approximation formulae. 

As an example of artificial networks, the Erdos-Renyi 
random graph [l8[ is used, with n = 1000 nodes and the 
probability of connection p — 0.01. The particular real- 
ization used is labelled Si for convenience and has 5004 



undirected links, without self-loops. The largest degree 
is d max = 20, the minimum is d m i n — 2, and the av- 
erage is dmean = 10.01. The largest three eigenvalues 
(in magnitude) of the corresponding adjacency matrix 
are computed to be A = 11.0741, A2 = —6.53518, and 
A3 = 6.50196. The components of the eigenvector v are 
shown in increasing order in Fig. (TJa) . We also analyze 
three real- world networks, which we refer to as S2, S3, 
and S4 for convenience. The basic properties of these net- 
works arc reported in Table (H along with the pertinent 
references. S2 is a biological example, S3 is a social inter- 
action network, while S4 can be regarded as an instance 
having both an engineering and social character. 

The impact on A of the removal of various subgraphs 
of Si is analyzed next: the results from the first and 
second order approximations are plotted versus the ac- 
tual SI. In Fig. QJb), the removal of edges is considered; 
the maximum reduction in A is about 0.1% and it is sat- 
isfactorily predicted by both the first and second order 
formulae: the former has a tendency of overestimating 
the change, while the latter is more accurate. As ex- 
pected, there are edges that have a greater impact on A 
than others. In particular, the impact of edge is 
dictated by the components Vi and Vj of v, as given in 
Eqs. ((2"Tj) and (|22p . The effect of removing a simple motif 
is shown in Fig. (He), where the 171 triangles occurring in 
Si are individually removed. The observed AA is higher 
in this case, though the approximations arc still satis- 
factory. Figure (TJd) investigates the removal of nodes, 
comparing Eqs. ((2T1) . ((2"5)) and ((3]): while the first order 
approximation is off by a factor of about 2, the second 
order formula with the d k /X 2 term is the most accurate. 
Note that for both the first and second order estimates 
the plots are almost monotonic, indicating that the rela- 
tive ranking of nodes, edges, and triangles defined by the 
SI are accurately estimated by these formulae. Indeed, 
for a randomly chosen pair of nodes or edges, the esti- 
mate is correct with probability close to one (Table [TTJ) . 
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TABLE II: Predicting the relative ranking of edges and nodes based on SI. The numbers indicate the fraction of all possible 
pairs of edges or nodes for which the relative ranking is correctly predicted by each approximation scheme. The local methods 
are based on the eigenvector components estimated by the normalized degree (LM1), the normalized sum of the neighbors' 
degree (LM2), and the normalized sum of the degrees of the neighbors' neighbors (LM3). 

Ranking of edges Ranking of nodes 









Local Methods 






Local Methods 


Networks 


Eq. (H31) 


Eq. CH} 


LM1 


LM2 


LM3 


Eq. (0 


Eq. CH]) 


LM1 


LM2 


LM3 


Si 


99.34% 


99.95% 


90.20% 


96.63% 


98.04% 


99.59% 


99.94% 


93.79% 


96.81% 


97.86% 


S2 


98.46% 


99.95% 


82.31% 


88.01% 


90.13% 


99.85% 


99.96% 


84.30% 


88.81% 


91.52% 


S 3 


98.96% 


99.97% 


85.08% 


91.40% 


93.85% 


99.86% 


99.95% 


87.65% 


91.88% 


94.64% 


S4 


96.86% 


96.51% 


83.68% 


91.07% 


93.60% 


96.59% 


95.92% 


85.91% 


82.40% 


81.99% 




A^appr ( % ) AX appr (%) 

FIG. 1: (Color online) Results for the Erdos-Renyi network 
Si- (a) Eigenvector components sorted in the increasing or- 
der. The true SI is plotted against its approximation (both 
in percentage) for the removal of (b) edges, (c) triangles, and 
(d) nodes. The black plus symbols correspond to the first 
order approximation (|15[1 and the red (light gray) squares to 
the improved approximation ()16p . In (d) the blue (dark gray) 
circles correspond to the approximation in Ref. [Ill ] . 



Figure shows the eigenvector components, the real 
SI, and the approximated SI for removing an edge and 
removing a node from the real- world networks S2, S3, 
and Si- The eigenvector components are shown in the 
order of increasing magnitude; in several cases, the small- 
est components appear to be rather small and fall below 
the axis limit on the figure. The presence of components 
in the dominant eigenvector spanning several orders of 
magnitude amounts to large discrepancies in the impor- 
tance of edges. When the removal of edges is analyzed, 
both the first and second order approximations for the SI 
are satisfactory. On the other hand, if removal of nodes 
is considered, the second order formula of Eq. (|^5|) , con- 



taining a correction for the degree of the node, yield re- 
sults more accurate than Eq. ©. In this case, the SI 
is as large as -7%. The relative ranking based on SI is 
also accurately predicted for these real- world networks, 
as shown in Table [TTJ Note that increasing the order of 
approximation improves the accuracy, except for the case 
of S-4- For node removals in 94, the rank prediction ac- 
curacy, although high in general, falls slightly with the 
increasing order of approximation. This is due to rela- 
tively large fluctuation of the approximation error among 
different nodes [Fig.[^i)], which is a likely consequence of 
heterogeneity and hierarchical nature of the power-grid 
network topology. 

Since the spectral gap A — A2 mainly determines the 
sensitivity of A to structural perturbations, it is directly 
related to the accuracy of our approximation formulae. 
Indeed, the larger the spectral gap, the better the approx- 
imation will generally be. Networks with large spectral 
gaps are known to be homogeneous and well-connected, 
avoiding structural bottlenecks [2l[ , and can also be char- 
acterized by having large expansion constant [22I [23j . 



IV. APPROXIMATING SI USING LOCAL 
INFORMATION 

In Section II, formulae for approximating the SI were 
given, based on Eq. (fl"5]) . However, the knowledge of 
both the largest eigenvalue A and its corresponding left 
and right eigenvectors u and v is required. Such infor- 
mation is in some situations impractical or even impos- 
sible to obtain, since it is equivalent to solving an eigen- 
value problem for the adjacency matrix A, which requires 
knowing all the entries of A. 

For a given set of links to be modified, however, our 
approximation formulae only require — aside from a nor- 
malization constant — a few components of u and v cor- 
responding to the nodes attached to these links. These 
u and v components can be approximated by iterative 
methods. When using the SI for ranking different sub- 
graphs, such as single edges or nodes, or pairs of edges or 
nodes, this approach can be useful because the normal- 
ization constant does not affect the ranking. 
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FIG. 2: (Color online) Results for the three examples of real- world networks S2 (top row), S3 (middle row) and S4 (bottom 
row) in Table [I] The left column [(a), (d), and (g)] shows the eigenvector components sorted in the increasing order. The 
middle column [(b), (e), and (h)] shows the true SI vs approximated SI for the removal of edges, while the right column [(c), 
(f), and (i)] is for the removal of nodes. The meaning of the symbols is the same as in Fig. [T] 



Assuming that the spectrum of A satisfies |AJ> JA9I > 
• • • > | A n |, one can adopt the power method [14l4l6l | to 
solve for the dominant eigenvalue A and its corresponding 
left and right eigenvectors u and v. The starting point of 
this method is a normalized vector v^°\ that in this case 
can be taken as 

V C°) = -L[l,l,...,lf. (29) 

Then, for t = 1,2,..., until convergence, the following is 
iterated: 

y {t) = V'" 1 ), AW = |b (t) || 2 , « (t) = V (t) /\\y (t) \\2. (30) 

The convergence of both the eigenvalue and eigenvector 
is geometric, with rate 0(| A2 / A|*) [39[. This algorithm 
can be straightforwardly adjusted for the computation of 



the left eigenvector u, and the same convergence rates 
apply. Although other iterative schemes for the compu- 
tation of the dominant eigenvalue and the corresponding 
eigenvector are available, the power method is used here 
since its iterations directly highlight the local information 
of a graph. 

Indeed, the first iteration of the power method gives 
the degree, the number of connections that each node 
has, up to a normalization constant. The fcth component 
of vS 1 ' is proportional to the in-degree of node k, = 
Y^i=i a iki while the kth component of scales with 
the out-degree of the same node, G?£ ut = J27=i a ki- If the 
graph is undirected and unweighted, the fcth component 
of both and are proportional to the number of 
direct neighbors that node k has (counting itself, if a 
self- loop is in place). 
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The second iteration of the power method returns in- 
formation about the number of connections that these 
neighbors have. For an undirected unweighted graph, 
the fcth component of and i/ 2 -* is proportional to 
the sum of the degrees of the direct neighbors (where 
the same node can be counted several times, and node k 
itself is always included in the count). If the graph is di- 
rected or weighted, the proper weights need to be added 
and the directions of the connections considered. Subse- 
quent iterations provide better approximations of the kth 
eigenvector component, involving larger neighborhood of 
node k. 

Combing these with Eq. ([To]) , we obtain successive ap- 
proximations to the SI. For edge in an undirected 
unweighted network, for example, the first two iterations 
give 



f(i) 



in jout 




(31) 
(32) 



Figure [3] shows the results of the local computation for 
the Erdos-Renyi graph Si. Similar results can be ob- 
tained for the networks S2, S3, and S4, which allow ac- 
curate prediction of edge- and node-ranking, as shown in 
Table HI1 Analogously to the effect of the order of approx- 
imation, increasing the number of iterations for the local 
method improves the accuracy for all cases, except for S4 
(due to the same large fluctuation of the approximation 
error among different nodes). The accuracy of this local 
approximation also depends on the ratio | A2 /A | , since it 
dictates the convergence rate of the method. 



V. PERTURBATION OF THE GRAPH 
LAPLACIAN 

Perturbation results, based on either global or local 
information, can analogously be derived for eigenvalues 
and eigenvectors associated with the graph Laplacian L, 
defined as L = D — A, where D is the diagonal matrix 
of node in-degrees. For simplicity, only connected and 
undirected graphs are considered, so that the associated 
graph Laplacians are positive-semidefinite matrices. The 
spectrum of L is assumed to satisfy 



= /ii < fi 2 < M3 < ••• < Mn-l < Mti 



(33) 



so that fi2 and /x„ are non-degenerate. The second small- 
est eigenvalue, /i2, and the largest one, are often used 
to characterize properties of the underlying graph. In 
particular, 02 is known as the algebraic connectivity of 
the graph [24[ and quantifies the connectedness of the 
graph (/i 2 = if the graph is disconnected). The alge- 
braic connectivity, as well as the eigenratio [iij '/x„, are 
closely related to the stability of synchronized states in 
coupled dynamical systems [25|, [26| . 
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FIG. 3: (Color online) Convergence of local SI approxima- 
tion for edge removal in the Erdos-Renyi network Si- (a) 
The eigenvector components sorted in the increasing order of 
their corresponding values computed globally [red (light gray) 
line]. LM1 denotes the approximation by the normalized de- 
gree (black cross symbols), while LM2 denotes the approxi- 
mation by the normalized sum of the degrees of the neighbors 
[blue (dark gray) dots] . (b) The SI for edge removal estimated 
using the approximations of the eigenvector in (a), showing 
quick convergence to the SI computed using the globally com- 
puted eigenvector. The first order formula Q2ip was used to 
estimate the SI. 



Denote by x and y the normalized eigenvectors related 
to ji2 and fj, n , respectively, 



Lx = fi 2 x, Ly = fj, n y, \\x\\ 2 = \\y\\ 



1. 



(34) 



If an arbitrary subgraph (assumed to be symmetric and 
with no self loop) is added to or removed from the original 
graph, then the adjacency matrix changes from A to A + 
B. The change in /i 2 and fi n can then be approximated, 
at the first order, by 



A/i 2 « ^2bij(xi - Xj) 2 



(35) 
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and 

Combining the two equations above and neglecting terms 
containing more than one A (either A// 2 or A/z ra ) the 
change in the eigenratio r — ^/fJ-n is predicted by 

Ar ~ T h v [Vnixi ~ Xjf ~ fJa(Vi ~ Vjf] ■ (37) 

Similarly to the formula for the dominant eigenvalue of 
A, the above equations can be adopted to develop strate- 
gies for targeting the network evolution towards some 
desired state, for example, to enhance (or weaken) the 
network synchronizability. Our formalism can also be 
extended to other spectral quantities. 

VI. SUMMARY AND CONCLUSIONS 

In this paper, we have introduced the concept of spec- 
tral impact of an arbitrary link modification in a network 
as the relative change in the largest eigenvalue of the ad- 
jacency matrix induced by the modification. Based on 
the standard perturbation method and an approxima- 
tion for the second order term, we obtained an improved 
approximation formulae for the spectral impact that re- 
quires only the most dominant eigenvalue of the original 
network and its left and right eigenvectors. Using the 
Erdos-Renyi random graph, as well as real-world exam- 
ples of large complex networks from biological, social, 
and technological applications, we confirmed the accu- 
racy of the formulae for the addition and/or removal of 
nodes, links, and triangles. We have also shown that the 
first iteration of a local approximation scheme based on 
the power method is equivalent to using the node (or 
subgraph) degree for ranking, and that further iterations 
quickly improve the accuracy by incorporating the con- 
nectivity structure of larger neighborhood of the node 
(or subgraph). The analysis leading to the approxima- 
tion formulae readily applies to the spectrum of other 
relevant matrices associated with the network, such as 
the Laplacian matrix treated briefly in this paper and 
the biased adjacency matrix studied in Rcf. [271 ]. 

Some problems on the approximation schemes still re- 
main open. How does the network topological structures, 
such as the small-world, scale-free, and modular struc- 
tures, affect the accuracy of the approximations? More 



generally, how does the robustness of the network with 
respect to its spectral properties depend on the network 
structure, and can it be used to classify networks, simi- 
larly to the existing spectral classification [2l| ? How can 
we appropriately measure the "smallness" of perturba- 
tion B to predict the accuracy? It is also important to 
extend our method to the case of degenerate dominant 
eigenvalues, which may arise when the network evolved 
under constraints or under pressure to optimize its func- 
tions HHHi. 

Our results have several potential applications for large 
networks whose performance depends on their spectral 
properties. The approximation schemes may be used in 
a damage control strategy for such networks, in which 
sudden structural damage that cannot be immediately 
fixed, such as the removal of multiple edges or nodes, is 
compensated by changes in other parts of the network 
(see Ref. [3(| for an example of such a compensatory 
perturbation in a different context). They may also be 
used to develop gradient-descent-like algorithms to solve 
the problem of designing networks that satisfy specific 
spectral (and thus dynamical) properties [3lM33j . or to 
develop efficient updating schemes for spectrum-based 
statistics of evolving networks, similar to those for lo- 
cal statistics reported in Ref. [12|]- The ranking of sub- 
graphs, or motifs, according to the spectral impact in a 
given network and for a selected eigenvalue (not neces- 
sarily the largest) gives rise to interesting questions: how 
does this ranking depend on the subgraph, the choice of 
the eigenvalue, and local and global properties of the net- 
work? Our improved formula reflects the fact that there 
is a nonlinear effect: the SI of the union of two subgraphs 
is not simply the sum of their individual SI. How does 
this nonlinear effect correlate with topological structures 
such as communities? With the tools developed in this 
paper, we wish to tackle some of the above open problems 
and applications in our future work. 
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